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What  are  the  Determinants  of  Situational  Awareness? 


Situational  Awareness(SA)=  the  proportion  of  the 
mission  critical  set  of  warfighting  platforms 
correctly  identified  by  a  warfighter  (COG  cf 
GT).(Hiniker  &  Entin,’90;Perry  et  al.  RAND’04) 


HI;  Use  of  a  Common  Operational  Picture(COP) 
by  a  warfighting  team  causes  improved  SA. 


H2:  Increased  time  spent  by  a  warfighting  team 
collaborating  with  the  COP  causes  improved  SA. 


Scenario 


Persian  Gulf  setting  where: 

-  Two  Blue  Ships,  CG,  and  DDG,  and  air 
protecting  several  oil  platforms  are  under  attack 
by 

-  Twelve  Red  fast  attack  craft,  Zhuks  and 
Svetlyzks 

-  Analogous  to  Operation  Praying  Mantis  in 
1988  and  to  the  Basrah  terrorist  incident  of 
Spring  2004 


Baseline  vs.  COP  Teehnology 


In  the  baseline  eondition,  eaeh  of  the  two  ship 
captains  has  only  his  local  tactical  picture  fed  by 
organic  ship  sensors  and  the  admiral  has  only  the 
big  picture  fed  by  satellites;  they  communicate  by 
voice. 

In  the  experimental  condition,  all  three  military 
players  share  a  COP  view  of  the  Gulf  (big  picture 
and  little  pictures)  and  communicate  via  voice. 


Set  Up  for  Exp:  Baseline  Condition 
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Simulator  Controller/ 
Red  Commander 


Set  Up  for  Exp:  COP  Condition 
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Simulator  Controller/ 
Red  Commander 


Move/Shoot 

Commands 


COP  Trac  Updates 


Creating  Team  Hardness  in  Lab 


-  Team  Hardness  =  the  completeness  of  the 
team  system  for  recording  and  retrieving 
info,  TM(T),  depends  on  how  frequently 
team  has  recently  collaborated,  T. 

-  T  =  t  +  T,  where  t  =  time  elapsed  since 
start  of  the  operation  and  t  =  length  of 
time  the  team  has  been  training  or 

operating  together  .(Perry,  signori,  &  Boone,2004) 


Results  for  HliCOP  causes 

improved  SA. 

Experiment  at  NOSC  with  3,  3-man  teams  proving  COP 
causes  increased  Situational  Awareness: 

Ax  =  .05,  .55  cf  .50,  n  =  12  trials,  confidence  =  98%* 

*Hiniker,P.&  Entin,E.  The  Effects  of  Shared  Battle  Graphics  on  Team  Performance  in  Crisis 
Situations:  HEAT  Experimental  Results.  Proceedings  of  the  JDL  BRG  C2  Research  Symposium^ 
July  1990. 

Experiment  at  MITRE  with  4,  3-man  teams  proving  COP 
causes  more  favorable  Loss/Exchange  Ratio: 

Ax  =  .14,  .68  cf  .54,  n  =  16  trials,  confidence  =  96%** 

**Hiniker,P.  &  Entin,E.  Cognitive  Processing  in  Command  Crises:New  HEAT  Experiments  on 
Shared  Battle  Graphics  &  Time  Tagging.  Proceedings  of  the  JDL  BRG  C2  Research  Symposium, 
July  1992. 


Results  for  H2:  Increased  time  spent  by  a 
team  collaborating  with  COP  causes 
increased  SA 


Time  Using  COP 


For  COP  Condition,  r  =  .76,  p  =  .07; 
for  Non-COP,  r  =  .95,  p  =  .004; 

for  Combined,  r  =  .95,  p  =  .003. 


Discussion 


Strong  experimental  support  was  found  for  (HI) 
use  of  COP  and  (H2)  Time  spent  by  team 
collaborating  as  causes  of  improved  Situational 
Awareness 

The  form  of  the  T — ^  SA  relationship  is  linear, 
within  the  time  range  observed. 

Models  of  NCW  involving  SA  should  develop 
hand  in  hand  with  experimental  investigations 


Model  Relationship  between 
TM(T)  and  T,  ( where  a  =  .01) 


Dynamic  Model  Relationship 
between  Situational  Awareness 
(A(t))  and  T,  (where  K  =  .98) 


Back-Up  Slides 


Examples  of  NCW  Parameter  Estimates 
Definition  of  NCW  Measures 
Data  Set 


Confidence  Intervals  for 
Differences  Due  to  Advanced  Tech  Usage  on 
Situational  Awareness  Parameters 


For  original  COP  cf  Partial  COP  Exp  atNOSC  where  sample  size  (n=12/2 
pairs),  sample  deviation  (s=.04),  p  =  true  population  differenee:  Obtained 
Situational 

Awareness  Ax  =  +.05 

.010  <p<  .090  @  98%  eonfidenee; 

.025  <p<  .075  @  90%  eonfidenee; 

.038  <p<  .062  @  75%  eonfidenee. 

For  augmented  Exp  with  sample  size  (n=16/2  pairs),  sample  deviation 
(assumed  s=.04).  Situational  Awareness... 

Ax  =.03,  yields  98%  eonfidenee  in  a  true  population  differenee; 
Ax=.02,  yields  90%  eonfidenee  in  a  true  population  differenee; 

Ax=.01,  yields  75%eonfidenee  in  a  true  population  differenee. 

For  Time  spent  by  team  eollaborating  with  COP, 

Ax  =  2.5%  per  hour,  where  0  <  T  <  240  minutes 


Measurement  Definitions  for  Operational  Assessment  of  COP  in  NCW 


•  Confidence  Intervals  for  ASA  (Ax)  from  exp,  for  t-distribution 
Ax-t^(s/Vn)  <  p  <  Ax  +  t^(s/Vn),  where  s  (Sxj /n-1) 

Confidence  intervals  for  ASA  (Ax)  from  exp,  for  F-distribution 
(X  ,-x,)  -  V(2(k-l)/n)  <  n  <  (X  i-x^)  +  V(2(k-l)/n), 

where  =  V(wss/k(n-l))  and  wss  =  within  groups  sum  of  squares 

•  Situational  Awareness  (SA)  =  Proportion  of  mission  critical  set  of  warfighting  platforms  correctly 

identified  by  a  warfighter  (Ground  Truth  cf  COG  @  tj) 

•Shared  Situational  Awareness  =  Proportion  of  overlap  between  pairs  of  COGs  for  complete  warfighting 
team. 

.Speed  of  Command  (t^  =  )’  where  total  speed  of  command  is  the  sum  of  time  to  size  up 

situation  +  time  to  plan  +  time  to  act  +  time  to  complete  decision  cycle  with  battle  damage 
assessment 

.Combat  Effectiveness  =  Loss/Exchange  Ratio=  red  platform  losses  /  (red  +  blue  +  neutral  losses) 


Grouped  Data  from  Exp.  Trials 

Sequence  of 

Observations  COP  no-COP  Delta 


1 1 

.56 

.48 

.08 

12 

.53 

.51 

.02 

13 

.58 

.51 

.07 
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